Object-Independent Human-to-Robot Handovers Using Real Time Robotic Vision
نویسندگان
چکیده
We present an approach for safe, and object-independent human-to-robot handovers using real time robotic vision, manipulation. aim general applicability with a generic object detector, fast grasp selection algorithm, by single gripper-mounted RGB-D camera, hence not relying on external sensors. The robot is controlled via visual servoing towards the of interest. Putting high emphasis safety, we use two perception modules: human body part segmentation, hand/finger segmentation. Pixels that are deemed to belong filtered out from candidate poses, ensuring safely picks without colliding partner. selection, modules run concurrently in real-time, which allows monitoring progress. In experiments 13 objects, was able successfully take 81.9% trials.
منابع مشابه
A Real-Time Object Recognition System Using Adaptive Resolution Method for Humanoid Robot Vision Development
The research of autonomous robots is one of the most important challenges in recent years. Among the numerous robot researches, the humanoid robot soccer competition is very popular. The robot soccer players rely on their vision systems very intensively when they are in the unpredictable and dynamic environments. This work proposes a simple and real-time object recognition system for the RoboCu...
متن کاملTowards Seamless Human-Robot Handovers
A handover is a complex collaboration, where actors coordinate in time and space to transfer control of an object. This coordination comprises two processes: the physical process of moving to get close enough to transfer the object, and the cognitive process of exchanging information to guide the transfer. Despite this complexity, we humans are capable of performing handovers seamlessly in a wi...
متن کاملDevelopment of a Reactive Mobile Robot Using Real Time Vision
In this paper, we discuss both theoretical and implementation issues of a vision based control approach applied to a mobile robot. After having brieey presented a visual servoing framework based on the task function approach, we point out some problems of its application to the case of mobile nonholonomic robots. We will show how using additional degrees of freedom provided by a manipulator arm...
متن کاملUsing Real-Time Stereo Vision for Mobile Robot Navigation
This paper describes a working stereo-vision-based mobile robot that can navigate and autonomously explore its environment safely while building occupancy grid maps of the environment. We present a method for reducing stereo vision disparity images to two dimensional map information. Stereo vision has several attributes that set it apart from other sensors more commonly used for occupancy grid ...
متن کاملReal-Time Vision for Robot Swat Juggling
This aper describes the implementation of a real-time vision system develope&~ track moving objects in real-time. In the implementation described, a 'puck" sliding on an inclined plane is tracked so that its position and veloaty may be used to "swat-juggle" it to a constant height at a specified set point. Raw centroid calculations of the uck based on images from a CCD camera are filtered using...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE robotics and automation letters
سال: 2021
ISSN: ['2377-3766']
DOI: https://doi.org/10.1109/lra.2020.3026970